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Abstract 

This paper describes the experience with impact assessment of 
toxic releases in a Substance Flow Analysis (SKA) for PVC in 
Sweden. For this system, all emissions related to the PVC-chain 
were inventoried. They have been evaluated making use of the 
Life Cycle Impact Assessment (LCIA) step from the CM 1.-guide, 
including the new toxicity equivalency factors calculated with 
the Uniform System for Evaluation of Substances (USES). The 
application of this method led to the conclusion that LCA Im¬ 
pact Assessment of toxic releases is still a major bottleneck: the 
USES-equivalency factors are not to be trusted due to outdated 
data, inappropriate defaults, etc. in the USES' substance proper¬ 
ties database. Therefore, a second USES-set of factors was cal¬ 
culated that differed up to factors of 1,000 or more from the 
old ones. Even these factors probably suffer from unacceptable 
high structural, in practice not reducible uncertainties. In con¬ 
clusion, we warn the LCA community not to overestimate the 
possibility of LCA Impact Assessment to obtain a meaningful 
priority setting with regard to toxicity problems. Instead, we 
propose developing indicator systems for LCIA of toxic releases 
that genuinely deal with all relevant types of uncertainty: data 
uncertainty, modelling uncertainty and particularly paradigmatic 
uncertainty. 


Keywords: LCA methodology, uncertainty, PVC; PVC, uncer¬ 
tainty, LCA; uncertainty, PVC, LCA; USES, uncertainty, PVC 


1 Introduction 

During the last decade, Life Cycle Assessment (LCA) has 
developed itself into an important tool for the environmen¬ 
tal improvement of products and processes. Starting as a 
methodology mainly focused at Life Cycle Inventory (LCI), 
concerning mass balance accounting of energy and materi¬ 
als of a complete system, large efforts have been made since 
the late eighties to use LCI data towards examining other 
environmental aspects of a system. Proposals for structur¬ 
ing this so-called Life Cycle Impact Assessment (LCIA) have 
been made among others by a number of international bod¬ 
ies and in a number of (inter)national methodology devel¬ 
opment projects (Hei.iungs etal., 1992; CoNSOuetah, 1993; 
Lindfors et ah, 1995; Braunschweig et ah, 1996). In many 
of those documents the desire is expressed that the list of 


environmental problems is as complete as possible, and that 
a high level of sophistication is striven for with regard to the 
way inventory data are used in the impact assessment (e.g. 
where possible making use of fate, effect and sometimes also 
background level and spatial information). This direction 
has been termed the expansionistic approach to LCA. At 
the same time, there have been warnings that striving for 
too much sophistication and completeness could not he jus¬ 
tified due to inherent weaknesses and uncertainties in the 
tools currently available for LCIA (Owens, 1996). Advo¬ 
cates of this view propose limiting the impact assessment in 
LCA to a small number of robust indicators, or to perform 
no impact assessment at all. This direction has been called 
the reductionalistic approach to LCA (Ki.Oi'Ffkr, 1996). 

Impact assessment of toxic releases is one of the most com¬ 
plex areas in LCIA. It thus may be the field for which this 
discussion is most relevant. TNO and CML experienced the 
practical usefulness of various toxicity impact assessment 
methods in recent case studies on chlorine and PVC that 
were dominated by tense societal debates on toxicological 
aspects (Kleijn etal., 1997; Tukker et al., 1995; 1996; 1997 
and 1998). Taking specifically the PVC-case as a basis, this 
paper addresses the following points: 

- practical experience with uncertainties in the USES-based 
method for toxicity impact assessment in LCA in the case 
of PVC; 

- an analysis of the probable importance of these uncer¬ 
tainties on a more structural, case-independent level, and 
their consequences for the viability of LCA impact as¬ 
sessment of toxic releases; 

- a review how such uncertainties have been addressed in 
the past, and an explanation for the apparent under-esti¬ 
mation of such uncertainties; 

- recommendations for approaches to address uncertainties 
adequately in LCA impact assessment of toxic releases. 

Though this paper primarily reflects experiences with regard 
to LCIA of toxic releases, we feel that there are parallels to 
other impact categories. The outlook in the final section may 
therefore have broader implications than for LCIA of toxic 
releases alone. 
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2 Life Cycle Impact Assessment of Toxic Releases 

Over the years, more and more sophisticated impact as¬ 
sessment methods have been developed for toxic releases. 
Around 1990, the so-called critical volumes approach was 
often used. A quantity of emitted substance to air was di¬ 
vided (mostly) by a policy standard for the desired air or 
water quality. Since those policy standards were not based 
on a uniform roxicological basis, subjective elements in the 
toxicity score of a substance were introduced. The CML- 
guide for LCA (Heijungs et al., 1992) made a major step 
forward by using a uniform toxicological basis, but still 
did not include the fate of a substance. Thus the potential 
toxic effects of readily degradable substances were still over¬ 
estimated by orders of magnitude in comparison to persist¬ 
ent substances like dioxins and metals. Aware of this draw¬ 
back, the authors of the Dutch guide recently published an 
approach that includes fate information based on the Uni¬ 
form System for Evaluating Substances (USES) (Guinee et 
al, 1996a). USES was originally developed as a support tool 
for substance policy. It had to give a first rapid, quantita¬ 
tive screening of the hazards and risks to man and the 
environment of a certain substance (Vermeirk and v.d. 
Zandt, 1995). USES consists basically of a Mackay Type- 
111 fate model that calculates estimated concentrations of a 
substance in the various environmental compartments on 
the basis of substance properties like degradation rates in 
various media, vapour pressure and octanol-water parti¬ 
tion coefficients. Based on these concentrations, the model 
is able to calculate the exposure of predators and humans 
making use of intake models. 

3 Uncertainties in a Case on PVC 

3.1 Introduction 

TNO and CML applied the new USES-based approach in a 
substance flow analysis (SFA) on PVC in Sweden, commis¬ 
sioned by Norsk Hydro (Tukker et al., 1996 and 1998). 
The flows of PVC in Sweden in 1994 were quantified, in¬ 
cluding the flows of PVC's precursors vinyl chloride, ethyl¬ 
ene dichloride and chlorine. The emissions of all substances 
from the processes that take place in this material chain 
were inventoried, as far as they were causally related to the 
material PVC. All emissions from the production plant, for 
instance, were taken into account for the PVC production 
itself, including emissions of non-halogenated substances. 
Emissions by chain part were evaluated making use of LCIA. 
In order to assess the importance of the contribution of the 
PVC-chain to Swedish environmental problems in relation 
to PVC's importance to the Swedish economy, normalised 
LCIA-scores were also calculated for each chain part. For 
the related normalisation data, we refer to Tukker and Kleijn 
(1996). Thus, in fact, we created an approach that com¬ 
bined elements of SFA and LCA in order to give a truly 
overall insight in the impacts related to PVC on Swedish 
territory. 


The main emissions from the system were several process 
emissions from the material production and waste manage¬ 
ment stage (e.g. VCM, EDC, dioxins, etc.), point source 
emissions from the manufacturing of PVC-products (mainly 
plasticisers used for flexible PVC, like phthalates) and dif¬ 
fuse emissions from the use stage (mainly evaporation and 
leaching of phthalates from flexible PVC). The most impor¬ 
tant phthalate included was DEHP, but in some applications 
other phthalates played a role (like BBP in flooring and D1DP 
in cable isolation). For an elaborated description of the 
method and data inventory we refer to Tukker et al. (1996 
and 1998). Here we will only discuss the results with regard 
to toxic releases. 


3.2 Problems with USES-based equivalency factors for 
toxicity impacts 

The new USES-based method for human toxicity gave a number 
of results that seemed not to be logical. For instance, we noted 
that the rather high phthalate emissions from coated fabrics 
lead to similar scores as the much lower emissions from soft 
tubes/hoses, in which a different plasticiser is used. Another 
problem was the score on terrestrial ecotoxicity: small emis¬ 
sions of DIDP from cables dominated the much higher emis¬ 
sions from other flexible PVC applications containing DEHP, 
like building plate. This was not expected since the toxicity 
and other substance properties of different phthalates are 
rather similar (Ke.mI, 1994; Janus et al., 1 994). Since all these 
results were directly a consequence of the values of the equiva¬ 
lency factors given in Guinee et al. (1996a), we decided to 
review the calculation of these equivalency factors. It ap¬ 
peared that the database with substance properties in USES 
contains outdated values, inappropriate default values or 
other errors. For instance, it appeared that for the calcula¬ 
tion of the equivalency factor for vinyl chloride (VCM) USES 
had inserted a default value for photochemical degradation, 
since no specific value was given in the original database. 
This led to unacceptable high life time estimates: 160 days 
in air, where 1-2 days is generally assumed as a realistic value. 
Such errors resulted in high differences in equivalency fac¬ 
tors for similar substances like DEHP and DIDP. 

Therefore, a revised input data set for USES was created 
making use of state-of-the-art literature and available data¬ 
bases (ISIS, undated; IUCLID, 1996; Verschueren, 1996, 
DOSE, undated, Howard et al., 1991). This was done for 
the substances that had the highest contribution to toxicity 
scores: the phthalates DEHP, DIDP and BBP, VCM, ethyl¬ 
ene dichloride (EDC), hexachlorobenzene and dioxins. For 
4 of the 7 substances checked, a number of the original in¬ 
put parameters of USES had to be changed. On the basis of 
the comparison, a most probable average value for the in¬ 
put parameters was chosen, and a second-set equivalency 
factor was calculated (called the improved TNO/CML set). 

This improvement lead to relatively high equivalency fac¬ 
tors for phthalates. This result was questioned by the Euro- 
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pean trade organisation of phthalate producers, the Euro¬ 
pean Council for Plasticisers and Intermediates (ECPI). ECPI 
is currently involved in preparing a hedset (harmonized elec¬ 
tronic data set) for substance properties of a number of 
phthalates within the framework of the EU existing chemi¬ 
cals programme. They delivered us a third set of data for 
phthalates which was based on even more recent, partly 
unpublished work. For the solubility and the bioconcen¬ 
tration factors (BCFs) large differences were found between 
the existing databases and the ECPI data. Since these pa¬ 
rameters are very important for the calculation of the 
equivalency factors, we decided to create a third set of equiva¬ 
lency factors. This ECPI data set was based on the work of 
Staples et al. (1996). They find that the differences between 
the solubility data for phthalates found in literature is mainly 
due to a number of experimental difficulties, like the inability 
to separate colloidal emulsions of undissolved chemicals in 
the aqueous phase, contamination from laboratory plastics 
and withdrawing samples through the surface film in which 
phthalates accumulate. All these problems can lead to experi¬ 
mental artefacts that yield measured values that overestimate 
the true water solubility (Staples et al., 1996). Furthermore, 
the group of Staples find that predictions of BCFs that rely on 
simple correlations with chemical hydrophobicity (as used in 
USES) are inappropriate if applied to phthalates since these 
models are based on data for persistent chemicals. I.owknbach 
et al. (1995) suggested an alternative approach by extrapolat¬ 
ing BCFs found with rodents to cattle (Staples et al., 1996). 
The BCFs found via this approach are a factor of 1000 to 
10000 lower then the BCFs that were calculated by USES on 
the basis of hydrophobicity; as a consequence, with a dra¬ 
matic change in values of the equivalency factors for phthalates. 

3.3 A first, case-specific assessment of uncertainties 

Some of the important differences in USES-input data we 
encountered in this process are reviewed in Table 1. Table 2 


reviews the effects on the values of the equivalency factors 
for toxicity themes for the 7 most important substances in 
our study. A more extended review than possible here is given 
in Annex III and IV of Tukker et al. (1996) (—> Appendix, 
Top 1) .The improved TNO/CML set results for VCM, DIDP, 
DEHP and BBP in quite different values as for the original 
LCA-USES set. The rather difficult to explain differences 
between the phthalates from the original LCA-USES set are 
diminished. Only BBP has a relatively high equivalency fac¬ 
tor for emissions to water which is logical due to its rela¬ 
tively high water solubility compared to DEHP and DIDP. 
The differences in solubilities in the improved TNO/CML 
set and the ECPI set have little effect on the equivalency 
factors. The differences in BCFs are only important for hu¬ 
man toxicity, and result in equivalency factors for the ECPI- 
set which are up to a factor of 500 to 1000 lower. 

It goes without saying that such differences can have dra¬ 
matic consequences for the results and policy conclusions of 
an LCA. For the 3 sets of equivalency factors based on the 
USES-model, Figure 1 (p. 250) provides the normalised theme 
scores from all emissions from the Swedish PVC-chain to¬ 
gether, and for 6 substances or substance groups emitted 
from the PVC-chain. For the sake of completeness, we fur¬ 
ther calculated normalised theme scores making use of 
equivalency factors of the CML guide of 1992 that did nor 
yet include fate modelling (Heijungs et al., 1992). 

When the LCA-USES set is applied, the emissions of VCM 
dominates the contribution of the PVC-chain to human tox¬ 
icity. But the toxicity score of the PVC-chain as such is very 
small compared to the Swedish total: only 0.002%, which is 
much lower than PVC's contribution to the Swedish Gross 
National Product (some 0.15%, see Tukker et al., 1996a). 
With the improved TNO/CML set, the picture changes dra¬ 
matically. VCM, so important with the LCA-USES set, is 
now invisible. Phthalates are now responsible for over 95% 
of PVC's score on human toxicity. Moreover, the normal- 


Table 1: Some examples of differences in substance properties 


Substance and data source* 

Vapour pressure 

Kow 

Photodegradation in 

Water solubility 

BCF fish 


(Pa, 20-25 °C) 


air (DT m in days) 

(mg/I) 

(kg/kg)** 

DEHP 

LCA-USES (GuinEe et al., 1996a) 

8,6 E-04 

5.24 

1 

0.045 

8083 

TNO/CML-set (literature average) 

1 E-04 

7.5 

1 

0.04 

1.47 E+06 

ECPI-set *** 

1.3 E-5 

7.5 

1 

0.003 

120 

IUCLID, 1996 

1 -8.6 E-04 

4.8-9.6 

0.6-2.2 

0.007-0.04 

114-886 

ISIS (undated) 

4.5 E-05 

3-4 

22 

0.35 

- 

EDC 

LCA-USES (GuinEe et al., 1996a) 

24000 

1.92 

80.21 

5500 

3.87 

TNO/CML-set (literature average) 

8500 

1.48 

100 

8700 

1.41 

IUCLID, 1996 

8330-8700 

1.45-1.46 

12-120 

8000-9000 

- 

VCM 

LCA-USES (GuinEe et al., 1996a) 

333000 

0.6 

160 

1100 

■i 

TNO/CML-set (literature average) 

333000 

1 

2 

1100 


IUCLID, 1996 

333000-340000 

1.36-1.58 

2.2-2.7 

915-1100 



* For each data source, the value or range of values is given. We analysed more sources than given in this table. The ECPI set was irrelevant for EDC and 
VCM, since ECPI gave no values for those substances. See further in the main text 
** For the LCA-USES-set and TNO/CML-set, all BCFs were calculated by USES on the basis of other input data 
*** Based on Staples et al. {1996) and Lowenbach et al. (1995) 
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Table 2: Toxicity equivalency factors from Gliinee et al. (1996a; the LCA-USES set), corrected after comparison with databases for physical chemical properties (the improved TNO/ 
CML-set) and factors based on physical chemical properties given by the ECP1 (the improved ECPI-set) 
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ised score on human toxicity from the PVC-chain is now 
only half of its contribution to the Swedish GNP and thus 
not negligible anymore. The policy conclusion would clearly 
be that phthalares emitted from the manufacturing of PVC- 
products and the use stage are the key issue with regard to 
human toxicity in the Swedish PVC-chain. But use of a third 
set, the ECPI set, once again would turn the tables. The con¬ 
tribution of the PVC-chain to the Swedish total diminishes 
dramatically and phthalates are hardly visible anymore. The 
new priorities are dioxins and to some extent EDC, calling 
for emission reductions in the EDC/VCM production and 
waste incineration. Finally, if we would have applied the old 
CML manual from 1992, once again other priorities would 
have arisen. EDC and VCM now are the most important emis¬ 
sions. NO v emitted from a EDC-cracking furnace, no issue 
in any of the other analyses, all of a sudden becomes impor¬ 
tant. The total score of the PVC-chain, with 0.036%, is all 
of a sudden a tangible fraction of the Swedish total score. 

In this comparison, particularly the dramatic difference be¬ 
tween the improved TNO/CML set and the ECPI set is rea¬ 
son for concern. Despite their contradictory outcomes they 
are based on a state-of-the-art fate and exposure model, and 
two equally acceptable data sets for substance properties 
(—» Appendix, Top 2). 


Several taxonomies of uncertainty have been developed. Most 
authors include two types of uncertainties: uncertainties that 
relate to quantitative data and the appropriateness of mod¬ 
els in describing the real world, and uncertainties related to 
implicit choices in problem definitions and value judgements 
in a method (Wynne, 1993; Douglas and Wildavsky, 1982). 
For a review we refer to v.d. Sluijs and Schulte-Fishkdick 
(1997). For the purpose of this paper, we will apply a tax¬ 
onomy developed by Rot.vians et al. (1994): 

1. data uncertainties: uncertainties in input data in a model; 

2. modelling uncertainties: uncertainties with regard to the 
model structure, the equations and parameter values; 

3. paradigm uncertainties: uncertainties due to the fact that 
a problem may be defined and analysed from different 
scientific perspectives. 

4.2 An analysis of uncertainty by type 

The data uncertainty aspect concerns the input data like tol¬ 
erable daily intakes (TDIs), BCFs, vapour pressures, etc. used 
to calculate equivalency factors with USES. Mainly this type 
of uncertainty, limited to substance-related fate data, has 


% of Swedish Total 



Fig. 1: Contribution of substance groups emitted from teh Swedish PVC-chain to the total Swedish score on human toxicity for 4 sets of 
equivalency factors 


4 Towards a Structural Analysis of Impact 
Assessment of Toxic Releases 

4.1 Introduction 

The case in the former section does not yet indicate if the 
encountered major uncertainties in impact assessment of 
toxic releases have a structural character. To analyse this 
point, we will make a distinction between levels of uncer¬ 
tainty and indicate what determines the magnitude of each 
level of uncertainty. 


been made visible in the case. Table 1 illustrates that the 
following types of problems exist: 

1. in some cases, like EDC here, just wrong basic data for 
substance properties might have been used; 

2. in some cases, like VCM and the phthalates here, inap¬ 
propriate default values for substance properties have been 
used; 

3. in other cases, literature is not unanimous about the value 
of key substance properties that form an input in USES, 
or data is simply lacking; 
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4. finally, for some substances it is questionable if the cur¬ 
rent literature values of substance properties have been 
assessed with an appropriate method (like here solubility 
and BCFs for phthalates). 

Of course some of these problems have no structural char¬ 
acter and can relatively easily be tackled, like point 1. But 
toxicological literature shows that the magnitude of all these 
data gaps and uncertainties can hardly be overestimated. In 
society about 100,000 chemicals are in use, of which 2,000 
are used in quantities over 1,000 ton a year in the EU. It is 
estimated that even for these 2,000 High Production Vol¬ 
ume Chemicals (HPVCs) a minimum screening information 
data set is available that allows for a first, rough insight in 
substance properties and toxic effects in only 5 to 10% of 
the cases (van Lekuwen, 1995). Recent, thorough analyses 
of the situation in the US confirmed the extent of these data 
gaps (Cranor, 1993, p. 27; EDF, 1997; US EPA, 1998). For 
the substances for which data is available, it is assumed that 
the assessment protocols leave room for outcomes that dif¬ 
fer one order of magnitude or more for the toxicological 
limit values alone, for example due to the choice of the high- 
dose to low-dose extrapolation procedure, differences in 
interspecies scaling factors, etc. (Cranor, 1993, p. 22; 
McCray, 1983). Recently, the book "Our Stolen Future" 
popularised another warning: it can even not be assumed 
that toxicological risk assessment has discovered all relevant 
types of toxic effects as such, as illustrated by the emerging 
debate on endocrine disrupters (Coi.horn et al., 1996). 

The modelling uncertainty aspect concerns uncertainties that 
are introduced by the structure of USES itself. USES does 
not take into account the fate and effects of a substance's 
degradation products, nor effects due to exposure to a 
combination of substances (GuiNf.E et al., 1996b). Further, 
the fate and intake modelling in USES is a simplification of 
reality, and may even not include relevant exposure routes. 
Hunt (1994) mentions the example that certain fat soluble 
contaminants may concentrate in the surface microlayer, a 
thin film of natural oils in surface water and sea. Eggs of 
certain fish species that float close to the surface may come 
in contact with this layer. This may lead to severe reproduc¬ 
tive effects, even at very low predicted concentrations of con¬ 
taminants in water which were never regarded as a prob¬ 
lem. In the case discussed in section 3, the influence of 
modelling uncertainty to some extent has been made visible 
by comparing results with toxicity impact assessment meth¬ 
ods that include and exclude fate modelling. 

The paradigmatic uncertainty aspect concerns the fact that 
different scientific perspectives are possible to analyse a prob¬ 
lem. These have not been made visible in our case, but can 
be illustrated as follows: LCIA of toxic releases is simply 
based on the assumption that knowledge is adequate to per¬ 
form a meaningful fate and effect modelling. Moreover, the 
residence time of a toxic substance in the environment is not 
treated as a parameter of special interest. What matters are 
predicted potential environmental concentrations and intakes 


- whether these are the result of large emissions of a sub¬ 
stance with a high degradation rate or smaller emissions of 
a persistent substance is irrelevant for the method. How¬ 
ever, for the manageability of the situation and the possibil¬ 
ity to correct wrong judgements, the difference in residence 
time (or persistence) is crucial. Groups like Greenpeace sim¬ 
ply disagree with the basic premise of LCIA: they fear that 
data and modelling uncertainties will be so high that major 
errors in toxicity assessments will frequently occur (Colborn 
et al., 1996; IJC, 1993). If this concerns a degradable sub¬ 
stance, mistakes can be corrected on short notice by dimin¬ 
ishing emissions, but this does not work for persistent sub¬ 
stances: emitted quantities from the past will be present for 
years, or decades to come in the environment. These aspects, 
that are two of the main reasons for conflicts between in¬ 
dustry and environmentalists on toxic substances, are sim¬ 
ply disregarded by the current methods for LCIA of toxic 
releases (Tukkkr, forthcoming). In this respect, it is useful to 
note that forums like the International Joint Commission 
for the Great Lakes in Canada and the US (IJC) have explic¬ 
itly decided to base their substance policy on the assump¬ 
tion that fate and effect modelling is an inappropriate basis 
for dealing with the risks of toxic substances. The IJC re¬ 
gards particularly the risks related to persistent substances 
as unassessable and thus unmanageable. Such substances 
therefore should be eliminated (IJC, 1993). A similar phi¬ 
losophy has been proposed by the Swedish National Chemi¬ 
cals Inspectorate (KemI, 1991) and more recently by the 
Swedish Chemicals Policy Committee (—> Appendix, Top 3). 

4.3 Are there easy solutions? 

It is generally recognised that the research needed to deal 
with the data and modelling uncertainties alone would cost 
decades, if not centuries, and is virtually unaffordable (IJC, 
1993). Under the EU, existing chemicals programme infor¬ 
mation comes available for only about 20 to 50 substances 
a year. This means that 40 to 100 years is required even to 
gather information for the 2000 HPVCs. And even then such 
fundamental problems like combination toxicity, the trans¬ 
lation of animal test data to safe levels in other species, high- 
dose to low-dose extrapolation, and the possibility that yet 
unknown effects will be discovered, are left unaddressed. 

Given the tremendous data gaps, there is therefore no choice 
in toxicological risk assessment but to apply stringent prior¬ 
ity setting procedures, supported by step-wise approaches 
to assess risks. In case of low data availability with regard 
to substance properties, conservative estimates in all extrapo¬ 
lation and estimation procedures for substance properties 
are initially used. With such data, a first rapid, quantitative 
screening of the hazards and risks to man and the environ¬ 
ment is performed with models like USES. If a risk is pre¬ 
dicted, additional research is done to get a better view on 
substance properties (Vermeire and v.D. Zandt, 1995). But 
in other cases there will be little incentive to perform addi¬ 
tional tests. In each improvement cycle, the main aim is to 
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prevent a false negative outcome in the evaluation (i.e. to 
judge that there is no risk, in a situation where there is a 
risk). In brief, this will lead to a situation where a rather 
good insight in substance properties will exist for a rela¬ 
tively small number of substances; for a large other set there 
will be mainly conservative estimates, and the majority of 
substances used in society will hardly demonstrate any data 
at all for the time being. It has to be stressed that this prob¬ 
lem is much more important in LCA than for the applica¬ 
tion for which USES was designed. USES was developed as 
a quick screening tool for a preliminary risk assessment, 
aimed at giving conservative answers on the question of 
whether a certain risk threshold may be exceeded. This is a 
decision with a simple yes-no character. LCIA includes the 
task of comparing the potential effects of substances: a rela¬ 
tive, quantitative comparison. For this purpose, it is manda¬ 
tory that in the average case, equal quality data be available 
for all relevant substances - a goal irrelevant for substance 
policy and, in fact, a situation that substance policy, due to 
the enormous costs, deliberately avoids by step-wise ap¬ 
proaches and priority setting schemes, in which USES plays 
a key role. In sum: models like USES may contribute to solv¬ 
ing problems in the field of the risk assessment of chemicals. 
But this does not automatically mean that such a model can 
be directly applied to solve problems in a field that has a 
different context, such as LCA (—» Appendix, Top 4). 


5 The Practice of Dealing with Uncertainty 

5.1 The field of LCA 

Until now, the LCA community has dealt only with partial 
success with uncertainty and ignorance. It is generally rec¬ 
ognised that the development of methods to deal with un¬ 
certainty in LCA is one of the research priorities for the com¬ 
ing years (Finnveden and Lindfors, 1997; Udo de Haes, 
1996). Most LCA manuals explicitly warn for the short¬ 
comings of certain approaches, specifically in the case of 
toxicity impact assessment (Heijungs et al., 1992; GuiNfiE et 
al., 1996b). Several LCAs have been performed in which 
results concerning toxicity were very prudently shown 
(Finnveden et al., 1996), or even deliberately excluded from 
the scope {Gunther and Langowski, 1997). At the same time, 
it seems that uncertainties, in practice, are neglected or under¬ 
estimated on a large scale. Respected manuals like the 1992 
CML guide, the recent report on the USES method, and the 
related software tools, due to the form in which they have 
been made available, are strong invitations to apply toxicity 
impact assessment methods that probably produce close to 
invalid results in quite a number of cases, irrespective of the 
warnings these documents may contain. They are, after all, 
written as manuals: booklets that are easily perceived by a 
scientific community as exemplars guiding how to perform 
state-of-the-art research in the field at stake (compare Kuhn, 
1962). In the period between 1992 and 1996, in numerous 
LCAs toxicity scores must have been produced, in most cases 


without questioning them despite their totally lacking fate 
modelling. We restrict our discussion to some personal ex¬ 
amples. In the Dutch chlorine chain study, TNO and CML 
based their conclusions with regard to the toxicity risks of 
chlorine mainly on risk assessment, but produced as a first 
approach also normalised toxicity theme scores using the 
1992 CML Guide (Tukker et al., 1995; Kleijn et al., 1997). 
They were widely communicated by industry (e.g. NCI, 
1995), which lead to strong and negative comments on the 
LCA method (Koeman et al., 1995; Copius Peereboom, 1996). 
The problems reported in section 3 with the USES-based 
method were fully unforeseen (—> Appendix , Top 5). CML 
felt it was necessary to send an explicit warning to those who 
had ordered the report that described the USES-method that 
was published months before (CML, 1996). Still, this warn¬ 
ing only indicated the problem of default values in USES, and 
not the other problems indicated in section 3.2 in this paper. 
The recent strategic research programme of LCANET mainly 
addresses data uncertainty and to some extent model uncer¬ 
tainty, but does not mention paradigmatic uncertainty (Udo 
de Haes and Wrisberg, 1997). Several documents discussing 
research needs in LCIA plea for the development of more struc¬ 
tural approaches to link inventory data or characterisation 
data with safeguard subjects - while such links may be sur¬ 
rounded with even more ignorance than the USES model in 
toxicity impact assessment. Underestimating uncertainty thus 
seems not to be an individual, but at least a partially collective 
process within the LCA-community (-> Appendix, Top 5a). 

5.2 Other areas 

A bit to our defence, the LCA-community is not unique in 
underestimating uncertainty. But at the same time this is a 
warning of how difficult it is to avoid this. The branch of 
the scientific community that studies how sciences develop 
themselves and make progress, the so-called sociology of 
science, has shown such struggles in dealing with uncertainty 
are more routine than an exception. The numerous case stud¬ 
ies published in Journals like Social Studies of Science and 
Science and Public Policy show that what scientists often 
present as independent knowledge is at best a mixture of 
facts and constructs: unconscious conventions within the 
scientific community at stake, implicit assumptions, and hid¬ 
den value judgements. This is not necessarily negative: the 
existence of such paradigms prevents scientists from having 
to question every piece of basic knowledge they use, and 
allows them to concentrate on the specific problem they want 
to solve (Kuhn, 1962). Such processes have been described 
in fields as diverse as energy policy (Thompson, 1984), geol¬ 
ogy (Bowden, 1985), climate change (Shackley and Wynne, 
1995; v.d. Sluijs, 1997), health care (Knorr-Cetina, 1985) 
and solar neutrino science (Pinch, 1981). This leads to the 
situation that facts are not necessarily accepted as authoritati¬ 
ve because they reflect some truth, but because they are vali¬ 
dated through processes of informal negotiation and can be 
ranged into frameworks of shared assumptions and interfer¬ 
ences (Jasanoff, 1987; 1990). 
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Authors like Weinberg (1972) have sought the answer in a 
rigorous separation of science from what he called trans¬ 
science: issues that "hang on the answers to questions which 
can be asked of science and yet which cannot be answered 
by science". Trans-scientific questions should in his view 
mainly be solved in a political setting. But in practice it is 
often observed that the opposite occurs (Jasanoff, 1987; 
Wynne, 1987). Rip (1992) noted that it is highly question¬ 
able if the current risk assessment systems for external safety 
can predict actual or potential risks with a meaningful cer¬ 
tainty. But it has the important advantage that the calcula¬ 
tions are standardised, which makes the decision making 
process much more predictable - and the system attractive - 
for both industry and the authorities. In Wynne's observa¬ 
tion on areas like external risk assessments of nuclear power 
plants, for example, regulatory bureaucracies are engaged 
in the conversion of sheer ignorance and implicit conflicts 
of perspective into manageable uncertainty (Wynne, 1987, 
p. 312). Driving forces behind such processes are, among 
other things, the demand of decision makers and the public 
for at least the appearance of certainty (Funtowicz and 
Ravetz, 1990; Smithson, 1993), the mainstream approach 
to risk assessment in the eighties (where relatively well-struc¬ 
tured, standardised engineering systems like chemical plants 
dominated as cases, and this approach seemed to easily adapt 
to the situation of nuclear plants) and the political climate 
of demand for the public justification of policy. By such 
mutual construction processes, practical knowledge is produ¬ 
ced. An appearance of factual solidity of science is created 
by legitimate, institutional agreements. Wynne (1987; 1993) 
refuses to call the choices made in such processes value 
choices that can be made explicit during scientific research. 
This does not take into account their depth and subtlety: 
individual scientists are just not aware of them, let alone 
they cannot identify and present them. On the contrary: if 
ignorance is revealed, the first reaction is in most cases to 
shoot the messenger rather than developing strategies for 
managing under ignorance (Smithson, 1993). 

5.3 Consequences for LCA impact assessment of toxic 
releases 

The consequences are obvious. Such practical, so-called con¬ 
structed knowledge will survive as long as societal actors 
have no reason or not enough power to start a conflict. But 
if, like in the case of the Dutch chlorine study, there is strong 
lack of consensus, (constructed) knowledge is put to test 
and thus subject to deconstruction, which leads to a good 
chance that until then hidden uncertainties or choices are 
made explicit (Rip, 1986). The credibility of decision mak¬ 
ing, predictably, is negatively affected (Wynne, 1987, p. 351). 
Since ignorance has been converted into apparently man¬ 
ageable uncertainty, another negative consequence is that 
this science cannot easily develop strategies to cope with 
surprise, and thus might enhance factual risk (Wynne, 1987, 
p. 325) (—* Appendix, Top 6). 


In the specific case of Life Cycle Impact Assessment of toxic 
releases, results should at least have enough validity to sup¬ 
port one of LCA's generally recognised application areas, 
such as (v.d. Berg et al., 1995): 

1. product comparisons; 

2. to help the design of new products or services; 

3. to indicate strategically the direction of development; 

4. monitoring the environmental impacts of a product, or 
comparing it with a benchmark; 

5. indicating the environmentally dominant stages in a prod¬ 
uct life cycle. 

The case and the subsequent analysis seem to leave little 
room but for the conclusion that in toxicity impact assess¬ 
ment uncertainty and ignorance are the dominant factors, 
and that even sophisticated methods like the USES-approach 
at this moment can do little more than to produce question¬ 
able results. An impact assessment method with such inher¬ 
ent weaknesses can serve little of the application areas men¬ 
tioned. Defining the goals and limits of LCA in terms of a 
Less is better concept (White et al., 1995) does not much 
change the situation. The key point is that, depending on 
the data set, the fate and exposure model, and the evaluative 
paradigm applied, different substances will dominate the 
others. Using one set of assumptions, less emissions of a cer¬ 
tain substance will hardly seem relevant, where using other 
sets, less emissions of the same substance will be regarded as 
the key factor for environmental success. Even a fruitful use 
in the less demanding applications like 4 and 5 will thus be 
frustrated, let alone in application 1 to 3, that have the addi¬ 
tional complication that in general comparisons between 
rather different systems are necessary. 

6 An Outlook for a Solution and Conclusions 

Altogether, this paper results in a number of worrisome and 
hard questions about the current practices of dealing with 
toxicity in LCA. The case in section 3 illustrated that uncer¬ 
tainty in state-of-the-art fate input data alone can result in 
fully contradictory policy advice with regard to toxicity prob¬ 
lems. Section 4 made plausible that such uncertainties are 
most probably structural, and suggested strongly that equally 
important uncertainties may be at stake for effect data and 
fate models as such. Finally, section 4 indicated that, given 
these large uncertainties, different groups in society develop 
different evaluative paradigms to judge a situation. The rel¬ 
evant types of uncertainty are visualised in Table 3, speci¬ 
fied by step in the emission effect-chain. 

We must reluctantly conclude that these levels of uncertainty 
have been underaddressed in the practice of LCIA to date. 
Even methods that lacked essential elements such as fate 
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Tabic 3: Types of uncertainty with regard to emissions, fate and effects of toxic substances 



Step 

Type of uncertainty 

Emission 

Fate 

Effect 

Data uncertainty 

Type and amounts of 
substances emitted 

Substance properties 
(fate) 

Environmental 

information 

Substance properties 
(toxicity) 

Modelling uncertainty 

n.r 

Extent to which the 
model reflects the real 
world 

n.r. 

Paradigmatic uncertainty 

Tacit biases and as¬ 
sumptions 

Tacit biases and as¬ 
sumptions 

Tacit biases and 
assumptions 


n.r: not relevant 

grey: type of uncertainty illustrated in the case 


modelling have been used for a considerable period as state- 
of-the-art tools to produce policy advice. LCIA of toxic re¬ 
leases thus seems to fall into the trap so many areas of sci¬ 
ence for policy have fallen into. In the (tempting) quest for a 
single calculation rule, the interpretative space is narrowed 
by a negotiation process within a specific community - in 
part probably unconsciously and/or informally. Ignorance 
is converted into an apparent manageable uncertainty, and 
plausible, thoughtful alternative evaluative perspectives of 
other important actor coalitions in society are simply ex¬ 
cluded or overruled. 

How can this situation he solved? Of course, one could re¬ 
frain from impact assessment. One could try to come to a 
judgement on the basis of rather robust emission inventory 
data and rudimentary logic - or otherwise simply acknowl¬ 
edge that one does not know (—> Appendix , Top 7). How¬ 
ever, this is not an ideal solution. There is the danger that a 
judgement is still made, but only implicitly (Joli.iet, 1996). 

In our view, the key to a solution is that the LCA commu¬ 
nity truly accepts the fact that LCIA of toxic releases is a far 
cry from the type of science that gave us robust calculation 
rules such as Ohm's law. As a consequence, we should get 
rid of the idea that we can assess such a thing as a single best 
truth in setting toxicity priorities in LCA. Policy sciences 
have convincingly shown that in the case of such important 
uncertainties, and a strong lack of consensus (such as in the 
PVC-debate). In general, a few evaluative paradigms play a 
role, which are equally acceptable, also in scientific terms. 
The starting point should therefore be an analysis of these 
different evaluative paradigms (see for toxicity: Tukker, forth¬ 
coming). The most plausible and consistent ones can be con¬ 
verted into LCIA indicator systems that reflect the different 
paradigmatic perspectives of stakeholders (—» Appendix, Top 
8). The best example currently available is the indicator sys¬ 
tem developed by Rotmans and de Vries (1997), who made 
use of the scientific perspectives that can be derived from 


the cultural theory of Thompson, Schwarz, Douglas, and 
others (Thompson et ah, 1990) (—> Appendix, Top 9). Once 
the paradigmatic uncertainties have been dealt with along 
such approaches, the more classical modelling and data un¬ 
certainty can be addressed (Heijungs, 1996). Only by this 
strategy does the LCA community live up to Weinberg's rules. 
The policymakers are supplied with information that do jus¬ 
tice to the existence of different, but equally plausible, con¬ 
sistent and thus acceptable types of logic. The final decision 
on the trans-scienrific aspects is left to the democratic deci¬ 
sion making process, instead of to the less democratic deci¬ 
sion making process based on the notion of an (apparent, 
but non-existing) scientific truth (—> Appendix, Top 10). Note 
this solution may imply that the current mainstream in LCIA 
development, that heavily relies on searching for one con¬ 
sensus method preferably based on models that link environ¬ 
mental interventions with safeguard subjects, has to be re¬ 
jected as a starting point (—A Appendix, Top 11). 

In our view, until approaches have been worked out that 
deal with paradigmatic, modelling and data uncertainty, all 
current methods for toxicity impact assessment should be 
very carefully applied. Practitioners that simply state that 
LCIA is unable to draw conclusions about toxic effects for 
the moment (Gunther and Langowski, 1997) probably do a 
better job than those performing an impact assessment and 
presenting results unconscious of their weaknesses. In this 
respect, there may be an even more important message for 
those involved in the development of manuals for LCIA. Such 
manuals have the function of exemplars, and are invitations 
to apply the methods presented in the manual without too 
many thoughts about the strengths and weaknesses of the 
method. It is therefore strongly suggested to refrain from 
publishing anything that looks like a guide for impact as¬ 
sessment, as far as it concerns themes that probably suffer 
from high uncertainties and as long as the guide is not able 
to include uncertainty in the impact assessment method (—> 
Appendix, Top 12). 
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Appendix 

1. Part III of Tukker et al. (1996) provides a full review of 
USES-input data we applied to calculate the different 
equivalency factors. Part IV of that study gives 
spreadsheets with the theme scores on human toxicity 
for the improved TNO/CML-set and the ECPI-set, in¬ 
cluding the contribution of each substance emitted from 
the Swedish PVC chain. Simple addition of the scores/ 
percentages for each individual emission of a substance 
(group) to water, soil and air provides the percentages 
in Figure 1. Part IV of Tukker et al. (1996) also pro¬ 
vides the emissions in kg for each individual substance. 
Furthermore, the equivalency factors relevant to the 
LCA-USES set can be found in Table 2, as well as the 
equivalency factors relevant for the CML 1992 set in 
Heijungs et al. (1992). With this data, the calculation of 
the percentages in the figure is straightforward. All nor¬ 
malisation data relevant for the percentages in the notes 
of the table can be found in Tukker and Kleijn (1996). 
In Tukker et al (1996) it was not useful at the end to 
include all figures or calculations made earlier with the 
erroneous equivalency factors of the LCA-USES set, let 
alone calculations based on the 1992 CML guide. The 
detailed spreadsheets of the latter calculations are there¬ 
fore not included in Tukker et al. (1996). They are also 
too long to be included in this paper. However, they are 
available on request from the author. 

2. In the same project, other results were found that are a 
reason to question the equivalency factors calculated 
with USES. Normalisation data for Sweden were calcu¬ 
lated making use of rather complete emission data from 
the Swedish EPA and extrapolated data from the exten¬ 
sive Dutch emission registration database (Tukker and 
Kleijn, 1996). On the Swedish total for human toxicity, 
chromium(VI) contributes 99%, chromium (III) 0.24% 
and lead 0.66%. This would imply that Sweden could 
reduce its human toxicity problems by 99.9% by 
concentrating its toxicity policy on just three substances, 
which seems a rather questionable result. A final, minor 
remark is that the equivalency factors for one of the 


Weinberg, A.M. (1972): Science and Trans-science. Minerva Vol. 
X Nr. 2, pp. 209-222 

White, P., B. De Smet, H.A. Udo de Haes and R. Heijungs (1995): 
LCA Back on Track, But is it one track or two? LCA-News 
(SETAC Europe) 5 No 3 p. 2-4 

Wynne, B. (ed.) (1987): Risk management and hazardous waste. 
Implementation and the Dialectics of Credibility. Springer- 
Verlag, Berlin/London 

Wynne, B. (1993): Uncertainty and environmental learning. In: T. 
Jackson (ed.): Clean Production Strategies. Lewis Publishers, 
Boca Raton/Ann Arbor/London/Tokio 


PAHs, benz-a-pyrene (BaP), have been calculated mak¬ 
ing use of TDIs given by V ermeire et al. (1991). Vermeire 
calculated his TDIs for soil remediation situations, and 
stated explicitly that - in such situations - oral intake 
was considered as the only relevant uptake route for 
PAHs. PAHs present in air are mainly taken in by inha¬ 
lation, which is a much more sensitive intake route due 
to carcinogenic effects on lung tissue. As a consequence, 
the TDI for the inhalation of BaP is a few 1,000 times 
lower than for oral intake. The LCA-USES manual thus 
greatly underestimates the relevance of BaP for human 
toxicity. 

3. As shown by e.g. Cowan et al. (1995), probably the 
steady-state concentrations in the most important me¬ 
dia such as water, soil and air can still be predicted with 
an acceptable uncertainty. But predicting the bioconcen¬ 
tration processes etc. in food webs, that specifically for 
persistent substances will be relevant for the potential 
toxic effects, seems to be of a different order of com¬ 
plexity (IJC, 1993). 

4. In fact, authors like Wynne (1987; 1993) mention the 
use of methodologies such as risk-assessment in differ¬ 
ent contexts as the context in which they were devel¬ 
oped as an important reason for the creation of - what 
he calls - structural uncertainty. 

5. During some lectures we held on this case, some people 
in the audience wondered if we had not applied the 
method to a rather difficult case. This suggestion does 
not seem to be appropriate. The draft LCIA method had 
been presented in a workshop in The Hague in April 
1996. There, the main point of discussion was whether 
it would be appropriate to apply USES to heavy metals, 
since USES was originally designed for organic sub¬ 
stances. In our case, we faced problems with straight¬ 
forward and well-known organic substances such as 
phthalates, VCM, and EDC. Neither in the manual nor 
during that workshop were these substance groups spe¬ 
cifically addressed as problematic. No one in my TNO/ 
CML project team foresaw the problems we finally faced. 
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5a. I submitted the initial draft of this paper in August 1997. 
In this final version, I only included the remarks made 
during the review process and did not try to include new 
developments in the debate. However, one remark has to 
be added here. Since late 1997, the attention for paradig¬ 
matic uncertainty seems to be enhanced in the LCA-com- 
munity. Documents now produced in the framework of 
CHAINET and the Dutch Ecoindicator '98 project now 
refer to work of Thompson (e.g. Thompson, 1991) and 
Rotmans (Rotmans and de Vries, 1997) as approaches to 
deal with (what I called: paradigmatic) subjectivity. 

6. To give an example related to daily life: it is like not 
having a map of Amsterdam during the 1997 visit of 
the SETAC Europe conference, and using the map of 
Taorima you still had from 1996 instead, since that is 
the only other map you have - where just keeping your 
eyes open would bring you further. 

7. An example of such an approach, where information on 
rather robust emission data is combined with rudimen¬ 
tary logic in order to set priorities, can be found in Fin- 
nveoen (1997). In a study performed by Giinthkr and 
Langowski (1997) on resilient floor coverings, he noted 
that toxicity aspects had nor been included, among others 
due to the fact that the authors were well aware of the 
problems related to the LCIA of toxic releases. Finnveden 
argues, nevertheless, that a preliminary comparison of the 
toxicological impacts of PVC flooring and polyolefin floor¬ 
ing is possible. His argument is that both floorings are 
based on petrochemical resources, so that the potential 
impacts caused by the production of polyolefins will also 
be present in the life cycle of PVC. But, he argues, PVC 
has the additional drawback that there are potential im¬ 
pacts and uncertainties related to the production of chlo¬ 
rine (mercury emissions), the production of EDC and VCM 
(organochlorine emissions), and the use of additives (pla¬ 
sticiser emissions). Thus, in his view, it is reasonable to 
assume that polyolefins may score relatively better on tox¬ 
icity impacts. In my view, the approach of building the 
argument is a good one, though in this specific compari¬ 
son one point may have been forgotten. Finnveden's ar¬ 
gument only holds if the use of petrochemical resources 
for both PVC flooring and polyolefin flooring is about 
equal, and there are no other product chains with poten¬ 
tial toxic impacts contributing to the production of 
polyolefin flooring. In that case, in the production chain 
of PVC flooring simply a number of additional emissions 
of potentially toxic substances can be found. However, in 
most cases the situation is more complex. In the produc¬ 
tion of pipes, for instance, considerably more petrochemi¬ 
cal resources are needed for PE pipes as for PVC pipes. 
Thus, here one enters the difficult comparison of addi¬ 
tional emissions in the production chain of ethylene (when 
PE is produced) with additional emissions specific for PVC. 

8. Note that we thus reject an approach of "Anything goes", 
or an approach that allows that consensus can overrule 


robust scientific knowledge such as Ohm's law. An evalu¬ 
ative paradigm that, for instance, is based on the premise 
that mankind descends from cockroaches cannot, of 
course, be taken into account. We merely assume that in 
cases such as the LCIA of toxic releases the number of 
such robust scientific claims is insufficient for conclusive 
statements. The robust claims can be seen as a limited 
number of spots on a piece of paper, which still can be 
linked in a number of ways to draw a full picture. 

9. In the near future, Hofstetter (forthcoming) will pub¬ 
lish a Ph.D. thesis that uses and elaborates the ideas of 
Thompson et al. and Rotmans and de Vries for LCIA. 
My own thesis analyses in depth the evaluative para¬ 
digms in the Dutch chlorine- and Swedish PVC-debate 
and, on that basis, provides a rough outlook of what 
such paradigm-dependent indicators should take into 
account (Tukkkr, forthcoming). 

A main warning in my thesis is that a straightforward 
use of Thompson's cultural theory once again may eas¬ 
ily lead to technocratic rules. The paradigms used by 
societal groups should be analysed as a start. For in¬ 
stance, the cultural-theory related indicator systems I 
have seen so far all miss one element that currently is 
the key topic in the Dutch chlorine debate. In concerns 
the possible release of chlorinated micropollutants, i.e. 
small but potentially toxic emissions of compounds not 
covered by classical monitoring systems. 

10. By the way, some sociologists of science do not see 
Weinberg's idea as a way out of the problem, and even 
do not see a problem as such. They simply argue that all 
knowledge is constructed, that not any piece of knowl¬ 
edge is constrained by the real world, and that construc¬ 
tion processes just should go ahead - the aim should be 
just to reach robust outcomes that are acceptable for 
societal actors (Rip, 1992), or are supported by the most 
powerful networks of scientists, politicians, etc. (Latour, 
1987). After the expansionistic and reductionistic views, 
this would result in the relativistic view on LCA - or 
Machiavellistic, as some prefer to term it (Amsterdams- 
ka and Hagendijk, 1990), since indeed, in this view, 
power play is in fact the only thing that still counts. 

11. In our view, reducing uncertainty by agreement on a 
convention after a consensus process or even a process 
backed by an authoritative panel is no solution. Such 
approaches lead inevitably to a construct that will not 
survive in a real controversy. Courts of Justice, for ex¬ 
ample, have decided not to accept even laws that pre¬ 
scribed certain sampling procedures for hazardous 
waste, since they gave no insight in the uncertainties. 

12. In this respect, its seems useful to add one of the state¬ 
ments made by v.d. Sluijs (1997) in his thesis: "For the 
main part, it will remain impossible to model the sys¬ 
tem earth". 
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